To leave alone; stop nagging or annoying: All they need is for Government to get off their backs/ Get this clown off my back
[1880+; the date is very imprecise; the notion of being a burden, on one's back, is found by 1677]